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FIG. 3D 
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INPUT IMAGE 



IMAGE PROCESSING AND SEGMENTATION 



TEXT LAYOUT ANALYSIS \^ 



LINE ART ANALYSIS |^ 



CONSTRUQION OF ALTERNATIVE GRAPH 



EXPORT TO STRUCTURED GRAPHIC EDITOR 



PRESENTATION TO USER FOR EDITING 
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I INPUT BINARY IMAGE ARR AY 



DETECT AND REMOVE HORIZONTAL LINES FROM BINARY IMAGE ARRAY 

-J- 

I OBTAIN ARRAYS' 

i 

I DEFINE STABLE GROUPS OF CONNEQED COMPONENTS IN B' k'^^* 

i 

I IF COMPONENT MINIMUM HEIGHT, THEN DEFINE AS TEICT '•'^ 

i 

I FORM NEIGHBOR LINK AMONG TEXT CONNECTED COMPONENTS '^^ 



I FORM TEXT-LINES BY HORIZONTAL GROUPING OF CONNECTED COMPONENTS ^^'^ 

i 

I ACCUMULATE BASIC TEXT-LINE ATTRIBUTES, WITHIN EACH TEXT-LInF] ^ 
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DETEa BULLETS U^'^fi 

i 



I FORMTEn-LINE-VERTICAL-LINKS BETWEEN DISTINQTEKT-UNES 

T 

I FORM TEXT-REGIONS BY VERTICAL GROUPINGS OF TE)Cr-LINES ^ -^^^^ 
I COMPUTETEXT REGION BOUNDING BOX ATTRIBUTES 



DERIVE FURTHER AHRIBUTES FROM THE REGION LINES 
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DEFINE REGION JUSTIFICATION AND INDENTATION PROPERTIES \ ^ 

FIG. 8B 
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I INPUT SET OF STROKE-FRAGMENT OBJECTS TYPICALLY REPRESENTED AS CHAIN-CODE CURVEs!] ^ 162 
I FORM CLOSED STROKE PATH OBJECTS \ ^^64 



REMOVE FROM THE CANDIDATE SET OF STROKE FRAGMENTS ALL STROKE FRAGMENTS THAT 166 
PARTICIPATE IN THE FORMATION O F CLOSED STROKE PATH OBJECTS RETURNED IN 164 

i 



INSTANTIATE DATA STRUCTURES, CALLED ALIGNMENT LINKS, FOR EVERY PAIR OF ENDS OF 
STROKE FRAGMENT CURVES THAT FORM A SPATIAL CONFIGURATION OF ALIGNMENT 



COMPUTATIONALLY SCRUTINIZE THE RESULTING ALIGNMENT LINKS, AND SELECT FOR 
FURTHER PROCESSING ONLY THOSE THAT ARE CLEAR AND UNAMBIGUOUS 



COLLECT ALLTRANSmVE CLOSURES OF STROKE FRAGMENTS JOINED BY SURVIVING 
ALIGNMENT LINKS. CALLTHESE ALIGNMENT CHAINS. 
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FOR EACH ALIGNMENT CHAIN, FPT A PARAMETRIC CURVE, E.G., A STRAIGHT LINE, TO THE SET 
OF STROKE FRAGMENTS FORMING A CHAIN. RECORD THESE AS ALTERNATIVE 
REPRESENTATIONS OF SKETCHED CURVES REPRESENTED BY THE ALIGNMENT CHAINS 
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INSTANTIATE DATA STRUCTURES, CALLED CORNER LINKS, FOR EVERY PAIR OF ENDS OF 
ALIGNMENT CHAINS THAT FORM A SPATIAL CONFIGURATION OF FORMING A CORNER 



-176 



COMPUTATIONALLY SCRUTINIZE THE RESULTING CORNER LINKS, AND SELECT FOR FURTHER 
PROCESSING ONLYTHOSE THAT ARE CLEAR AND UNAMBIGUOUS 



COLLECT ALL TRANSITIVE CLOSURES OF STROKE FRAGMENTS JOINED BY SURVIVING 
CORNER LINKS. CALL THESE OPEN CURVILINEAR PATHS. 



APPLY SYMBOL RECOGNITION PROCEDURES TO THE STROKE FRAGMENTS REMAINING AFTER 
STEP 166. FOR EACH SYMBOL RECOGNIZED, RECORD AS ALTERNATIVE INTERPRETATIONS 
THE RECOGNIZED SYMBOL AND THE SUBSET OF STROKE FRAGMENTS THAT MATCHES THE 
CURVILINEAR FEATURES OF THE SYMBOL 



FOR EACH CLOSED STROKE PATH OBJECTS DELIVERED IN STEP 164, EHRACT THE SUBSET OF 
STROKE FRAGMENTS THAT PARTICIPATE IN THE PATH, AND PERFORM STEPS 168 THROUGH 
174. RECORD IN AN INTERMEDIATE DATA STRUCTURE THE GROUPS OF STROKE FRAGMENTS 
FORMING THE RELATIVELY STRAIGHT SIDES OF THE CLOSED OBJECTS. 



FOR EACH CLOSED STROKE PATH OBJECTS DELIVERED IN STEP 162 PERFORM A MODEL-BASED 
SHAPE RECOGNITION PROCEDURE. RECORD RECOGNIZED SHAPES AS 
ALTERNATIVE INTERPRETATIONS. 
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FIG. 9B 
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FIG. 7 OA 
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INPUT TO THE PROCEDURE LISTS OF TEXT OBJECTS, OPEN CURVILINEAR PATH OBJECTS, 
CLOSED CURVILINEAR PATH OBJECTS, AND SYMBOL OBJECTS 
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FOR EACH CLOSED CURVILINEAR PATH, AN INTERMEDIATE DATA STRUCTURE (CALL THIS A 
B-STRUCT) IS FORMED AND THE LIST OF ALTERNATIVE INTERPRETATIONS OF THIS 
CLOSED PATH ARE ENTERED 



FOR EACH OPEN CURVILINEAR PATH, FORM AN INTERMEDIATE B-STRUCT STRUCTURE, AND 
PLACE THE LIST OF ALTERNATIVE INTERPRETATIONS OF THIS OPEN PATH IN THE B-STRUCT 



FOR EACH TEXT GROUP FORM AN INTERMEDIATE B-STRUCT STRUCTURE, AND PLACE THE LIST 
OF ALTERNATIVE INTERPRETATIONS OF THIS TEXT IN THE B-STRUCT 
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DCTERMINE CONTAINMENT REIATIONS. FOR EACH B-STRUCT REPRESENTING A CLOSED 
CURVILINEAR PATH, TEST ALL OTHER B-STRUCTS AND DETERMINE WHCTHER THE LATTER 
OBJECT IS CONTAINED WITHIN THE BOUNDS OF THE CLOSED CURVILINEAR PATH. IF SO, 
DENOTE THIS RELATION. 



SELECT ALL B-STRUCTS FOR WHICH THE COMTAINED-BY SLOT IS EMPH FOR EACH SUCH 
B-STRUCT, CREATE A NODE FOR THE ALTERNATIVE GRAPH OF TYPE ALTERNATIVE. 
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FIG. 12A 
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FOR EACH ALTERNATIVE NODE: 
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TRAVERSE THE COLLECTION OF OBJECTS RELATED TO THE ALTERNATIVE NODE'S B-STRUCT. 
AT EACH B-STRUCT ENCOUNTERED, COUNT THE NUMBER OF ALTERNATIVE INTERPRETATIONS. 
CALL THE MAXIMUM OF THIS COUNT OVER ALL THE DESCENDANTS OF THE 
ALTERNATIVE NODE, N. 
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I CREATE N NODES OF TYPE, CHOICE, AND^LINK THESE TO THE ALTERNATIVE NODE \ ^ ^ 



FOR EACH CHOICE BRANCH OF THE ALTERNATIVE NODE, PROCEED TO CONSTRUCT A TREE OF 

DESCENDANT AND NESTED OBJECTS BY FOLLOWING LINKS TO B-STRUCT STRUCTURES 
THROUGH CONTAINS SLOTS AND ALT-INTERPRETATION-LIST SLOTS 



FIG. UB 
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START A POWERPOINT APPLICATION INSTANCE USING THE PUBUSHED COM API ^ -^^^ 

224 



EXAMINE THE LIST OF ALTERNATIVE NODES IN THE ALTERNATIVE GRAPH AND DETERMINE THE 
MAXIMUM NUMBER OF CHOICE NODES, N. 



USING THE INTERACTION OBJECT Wti THE POWERPOINT APPLICATION, CREATE N NEW 
POWERPOINT SLIDES. 
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FOR EACH ALTERNATIVE NODE OF THE ALTERNATIVE GRAPH, RECURSIVELY INSTANTIATE CHILD 
OBJECTS BY SENDING THE SPECIFICATIONS OF THE OBJECT TO THE RUNNING 
POWERPOINT APPLICATION. FOR EVERY TEXT OR GRAPHIC OBJECT THUS INSTANTIATED, 
THE POWERPOINT APPLICATION RETURNS AN OBJECT IDENTIFIER. 



WHEN A NODE OF TYPE GROUP IS ENCOUNTERED, RECURSIVELY INSTANTIATE OBJECTS 
LISTED IN THE GROUP'S MEMBER LIST COLLECT IDENTITIES OF ALL INSTANTIATED OBJECTS 
AND INSTANTIATE A POWERPOINT GROUP OBJECT LISTING THESE AS MEMBERS 
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